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Abstract. We discuss a generic model of Bayesian inference with binary variables 
defined on edges of a planar graph. The Loop Calculus approach of [I] is used 
to evaluate the resulting series expansion for the partition function. We show that, 
for planar graphs, truncating the series at single-connected loops reduces, via a map 
reminiscent of the Fisher transformation [3] , to evaluating the partition function of the 
dimer matching model on an auxiliary planar graph. Thus, the truncated series can be 
easily re-summed, using the Pfafhan formula of Kasteleyn |4]. This allows to identify 
a big class of computationally tractable planar models reducible to a dimer model via 
the Belief Propagation (gauge) transformation. The Pfaffian representation can also be 
extended to the full Loop Series, in which case the expansion becomes a sum of Pfaffian 
contributions, each associated with dimer matchings on an extension to a subgraph of 
the original graph. Algorithmic consequences of the Pfaffian representation, as well as 
relations to quantum and non-planar models, are discussed. 
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1. Introduction 

Bayesian Inference can be seen both as a sub-field of Information Tlieory and of general 
Statistical Inference [5]. A typical problem in this field is: given observed noisy data 
and known statistical model of a noisy communication channel (transition probability), 
as well as a prior distribution for the input (a pre- image), find the most likely pre-image, 
or compute the a posteriori marginal probability for some part of the pre-image. 

This field is also deeply related to Combinatorial Optimization, which is a branch 
of optimization in Computer Science, related to operations research, algorithm theory 
and complexity theory [6J. A typical problem in Combinatorial Optimization is: solve, 
approximate or count (exactly or approximately) instances of problems by exploring the 
exponentially large space of solutions. In many emerging applications (in magnetic and 
optical recording, micro-fabrication, chip design, computer vision, network routing and 
logistics), the data are structured in a two-dimensional grid (array). Moreover, data 
associated with an element of the grid are often binary and correlations imposed by 
the problem are local, so that only nearest neighbors on the grid are correlated. Such 
problems are typically stated in terms of binary statistical models on planar graphs. 

In this paper, we discuss a generic problem of Bayesian inference defined on a 
planar graph. We focus on the problem of weighted counting, or (from the perspective of 
statistical physics) we aim to calculate the partition function of an underlying statistical 
model. As the seminal work of Onsager [7] on the two-dimensional Ising model and its 
combinatorial interpretation by Kac and Ward [S] have shown, the planarity constraint 
dramatically simplifies statistical calculations. By contrast, three-dimensional statistical 
models are much more challenging, and no exact results are known. 

Building on the work of physicists, specifically on results of Fisher j3l |9] and 
Kasteleyn [UIIO], Barahona [11] has shown that calculating the partition function of the 
spin glass Ising model on an arbitrary planar graph is easy, as the number of operations 
required to evaluate the partition function scales algebraically, 0{N^), with the size 
of the system. To prove this, the partition function of the spin-glass Ising model was 
reduced to a dimer model on an auxiliary graph, and the partition function was expressed 
as the Pfaffian of a skew-symmetric matrix defined on the graph. The polynomial 
algorithm was later used in simulations of spin glasses [12]. However, Barahona also 
added a grain of salt to the exciting positive result, showing that generic planar binary 
problem is difficult [HI [T3]. Specifically, evaluating two-dimensional spin glass Ising 
model in a magnetic field is NP-hard, i.e. it is a task of likely exponential complexity. 

When an exact computational algorithm of polynomial complexity is not available, 
efficient approximations become relevant. Typically, the approximation is built around 
a tractable case. One such approximate algorithm built around the Fisher-Kasteleyn 
Pfaffian formula was recently suggested by Globerson and Jaakkola in [1^. Although 
this approximation (coined "planar-graph decomposition" ) gives a provable upper bound 
for the partition function for some special graphical models, it constitutes just heuristics, 
i.e. it suffers from lack of error-control and the inability of gradual error-reduction. 
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Controlling errors in approximate evaluations of the partition function of a graphical 
model is generally difficult. However, one recent approach, developed by two of 
us and called Loop Calculus [H |2], offers a new method. Loop Calculus allows to 
express explicitly the partition function of a general statistical inference problem via an 
expansion (the Loop Series), where each term is explicitly expressed via a solution of 
the Belief Propagation [El HSl E] , or Bethe-Peierls [El HH [20] (BP) equations. This 
brought new significance to the BP concept, which previously was seen as just heuristics. 

The BP equations are tractable for any graph; generally, the number of terms in 
the Loop Series is exponentially large, so direct re-summation is not feasible. However, 
since any individual term in the series can be evaluated explicitly (once the BP solution 
is known), the Loop Series representation offers a possibility for correcting the bare 
BP approximation perturbatively, accounting for loop contributions one after another 
sequentially. This scheme was shown to work well in improving BP decoding of Low- 
Density Parity Check codes in the error-fioor regime, where the number of important 
loop contributions to the Loop Series is (experimentally) small, and the most important 
loop contributions (comparable by absolute value to the bare BP one) have a simple, 
single-connected structure [211 122] ■ In spite of this progress, the question remained: what 
to do with other truly difficult cases when the number of important loop corrections is 
not small, and when the important corrections are not necessarily single-connected? In 
general, we still do not know how to answer these questions, while a partial answer for 
the important class of planar models is provided in this paper. 



1.1. Brief Description of Our Results 

In this manuscript we show that, for any graph (planar or not), the partial sum of the 
loop series over single-connected loops reduces to evaluation of the full partition function 
of an auxiliary dimer-matching model on an extended, regular degree-3 graph. Weights 
of dimers calculated on the extended graph are expressed explicitly via solution of the 
respective BP equations. The dimer weights can be positive or negative. In general, 
summing the single-connected partition is not tractable. However, in the planar case, 
it reduces (through manipulations reminiscent of the Fisher-Kasteleyn transformations) 
to a Pfaffian defined on the extended graph, which is also planar by construction. Thus, 
we find a big class of planar graphical models which are computationally tractable 
by reduction (via a BP/gauge transformation) to a loop series including only single- 
connected loops, and summable into a Pfaffian. Moreover, we find that the partition 
function of the entire Loop Series is generally reducible to a weighted Pfaffians series, 
where each higher-order Pfaffian is associated with a sum of dimer configurations 
on a modified subgraph of the original graph. Each term in the Pfaffian series is 
computationally tractable via the Belief Propagation solution on the original graph. 
The material in the manuscript is organized as follows. A formal definition of 



the model is given in Section 1.2 and a brief description of Loop Calculus PI |2] forms 



Section 1.3 Some introductory material on the graphical transformations is also given 
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in Appendix A Section |2] is devoted to re-summation of the single-connected loops in the 



Loop Series (we called it single connected partition). Section 2.1 introduces graphical 
transformation from the original graph Q to the extended graph Qe, reminiscent the 
Fisher transformation [3l|9]. This allows to restate the single-connected loop partition 
of the Loop Series on the original graph in terms of a sum over dimer configurations on 



the extended graph. Subsection 2.2 adapts the Kasteleyn transformation [U [TO] to our 
case, thus expressing the partition function of the single-connected series as a Pfaffian 
of a matrix defined on the extended graph. Section [3] describes a set of graphical models 
reducible under Belief Propagation gauge (transformation) to a Loop Series which is 
computationally tractable. Section |4] describes the representation of the Loop Series for 
planar graphs in terms of the Pfaffian Series, where each Pfaffian sums dimer matchings 
on a graph extended from a subgraph of Q, with the later correspondent to exclusion 
of an even set of vertices from Q. Grassmann representations, as well as fermionic 
models are discussed in Section |5| a general set of Grassmann models on super-spaces 



is given in Section 5.1, while Section 5.2 addresses the relation between binary models 



and integrable hierarchies. A brief list of future research topics is given in Section |6j 
1.2. Vertex-function Model 

We introduce an undirected graph Q = (V, S) consisting of vertices V = (a = 1, ■ ■ ■ , A^) 
and edges S. This study focuses mainly on planar graphs, like those emerging in 
communication or logistics networks connecting or relating nearest neighbors on a 2d 
mesh or terrain. However, the material discussed in the present and the following 
Subsections is general, and applies to any graph, planar or not. A binary variable, 
(Tab = ±1, which we will also be calling a spin, is associated with any edge (a, b) G S. 
The graphical model is defined in terms of the probability function 

p{a) = Z-'llf,{aa), (1) 

aeV 

for a spin configuration a = {aab = ±l|V(a, b) E £}. In ([!]), cja = (o"a{,|V6, s.t. (a, b) G £) 
is the vector built from all edge variables associated with the given vertex a. f^s are 
positive and otherwise we will assume no restrictions on the factor functions. Z is the 
normalization factor, the so-called partition function of the graphical model. 

We refer to ([T]) as "vertex-function" models, according to statistical physics notation 
[18] . In the information theory, they are known as Forney-style graphical models [23112^. 

We will assume in the following that the degree of connectivity of any vertex in the 
graph is three. Note that this is not a restrictive condition, as the n-th order vertices, 
correspondent to ra-spin interactions with n > 3, can always be represented in terms of a 
product of triplet terms. Then the n-th degree vertex can be transformed into a planar 
graph consisting of degree three vertices. We discuss transformations to the triplets, in 
general but also on some examples (Ising Model and Parity Check Decoding of a linear 



code), in Appendix A 
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1.3. Loop Calculus 

Loop Calculus [H |2] gives an explicit expression for Z through the Loop Series: 

Z = Zo-z, z= 1 + ) ' = (^fc)gc ^"'""^ (2) 

bec 

rriab = '^O-abbabicTab), fiafic = ^ Y\. ^^""^ ~ ^ab)ha{^a), (3) 

(^ab Sa beac 

where C can be any allowed generalized loop on the graph Q, i.e. C is a subgraph of 
Q which does not contain any vertices of degree one; dc is a set of vertices of graph Q 
which are also contained in the generalized loop C (by construction d consists of two or 
three elements); and ba{ffa) and hab^cFab) are beliefs associated with vertex a and edge 
{ah). The beliefs are defined via message variables rjab 7^ T]ba 

2 cosh {r]ab + Vba) 



fai^a) exp ( Vab(7ab 

V a G V : = \ , (5) 

E<?, exp [J2c Vacf^a 



solving the following system of the Belief Propagation (BP) equations 

/ (a,6)e£: \ 

y {a,b) e S : ^ fai^a) exp I ^ r/abCTab ((Tafe " tauh {riab + Vba)) = 0. (6) 

<?a \ 6 / 

The bare (BP) partition function Zq in Eq. ([2| has the following expression in terms of 
the message variables: 

) exp ( E(a^b)g£- Vab(^ab] 

° n(a,6)e£ [2cosh(ry„b + r76a)] 



BP equations (|6j) are interpreted as conditions on the gauge transformations, leaving 
the partition function of the model invariant. These equations may allow multiple 
solutions, related to each other via respective gauge transformations. The multiple 
solutions correspond to multiple extrema of the Bethe Free Energy and Loop Series can 
be constructed around any of the BP solutions. [|] 

2. Re-summation of the Single-connected Partition 

In the following we will show how to re-sum a part of the Loop Series accounting for all 
the single-connected loops, i.e. subgraphs of Q with all vertices of degree two 

VaeC, \S{a)\c=2 

Zs = Zq - Zs, Zs = l+ ^ rc, (8) 

ceg 

I See [TJ m m] for a detailed discussion of this and other related features of BP equations as gauge 
fixing conditions. 
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A ^ A 
A ^ A 

Figure 1. Left panel: Transformation from a vertex of G to respective three-vertex 
of the extended graph C/g. Right panel: maps from the colorings of a vertex of Q to 
coloring of the respective 3- vertex of Qe- Notice, that the coloring of the external edges 
of Ge are reversed in comparison with the coloring of original edges on Q. 

where [^(a)!^ stands for the number of neighbors of a within C. The evaluation will 
consist of the following two steps: 

A) Show that Zs is equal to the partition function of the dimer-matching model on 
an auxiliary graph, Qg. The graph will be constructed from the original Q by 
a transformation reminiscent of the Fisher's trick, introduced in [31 [HI [H] to 
streamline reduction of Ising model to the dimer-matching model; 

B) Use the Pfaffian formula of Kasteleyn [U [101 [H] to reduce Zg to a Pfafiian of a skew- 
symmetric matrix defined on Qe- Note that complexity of the PfafSan evaluation 
is A^^, where N is the size of Q. 

Note: while A) is valid for any graphical model, B) applies only to the planar case. 
2.1. Transformation to Dimer Matching Problem 

Following the construction of Fisher |31 we expand each vertex of Q into a three- 
vertex of the extended graph Q^-, according to the scheme shown in the left panel of 
Figure 1. Consider a vertex a of ^ and assume that 6, c, d are three neighbors of a 
on Q. For each vertex a, there are three /ia;ac contributions of degree two within a 
generalized loop C, i.e. with \5dc\ = 2, which can possibly contribute to the single- 
connected partition r^: fia;bc, fJ^a-M^ f^a.;cd- We associate the three weights with internal 
edges of the respective three- vertex of Qe, while the weights of all the external edges of 
the three-vertex are equal to unity. Then any coloring of the original graph, marking 
a single connected loop of Q, is in the one-to-one correspondence to a dimer-matching 
(which we also call coloring) of Q^. The weights and coloring assignments are illustrated 
on an example at the left panel of Figure 1. An example of transformation mapping a 
single-connected-loop on Q respective dimer on Q^, is shown in Figure [2j 

This map from the single-connected loops to dimers leads to the following 
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Figure 2. Example of G (upper left) to Ge (lower right) map. Single connected loop 
of G (shown in red) is in one-to-one correspondence with a valid dimcr matching of Ge, 
where dimers are also shown in red. 



'4> 




Figure 3. p orientation (left panel) and respective dimer (matching) configurations 



(right panel) correspondent to example of Ge described by Eq. ( 10 1 



representation for the single-connected partition Zg 

E ^^^^ 1 ' (9) 

b I 

where the dimer-weights on Qe are defined according to the simple rules explained in 
the previous paragraph. One finds that the right hand side of ^ is nothing but the 
partition function of a dimer-matching problem on Qg. 



2.2. Pfaffian Expression for the Partition Function 

Kasteleyn has shown in [U [10] (see also [11]) that Zs is equal to a Pfaffian (the square 
root of determinant) of a skew-symmetric matrix A = — A* of size Na x Na, where Na 
is the number of vertices in Qa- Each element of the matrix with a > b (ordering is 
arbitrary, but it is fixed once and forever) is Aab = Pab^ab, where Pab = ±1- There 
are many possible choices of p = {iTab = € Ge) which guarantee the Pfaffian 

relation: z. = V deti. A simple constructive way of choosing such a valid p is to relate 
it to orientation of edges in a directed version of Qa, built according to the following 
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"odd-face" rule: number of clockwise-oriented segments of any internal face of Ge should 
be negative. [§] Example of a valid orientation is shown in Figure |2] and the respective 
expressions are 



Zs;example — /^12/^34+A''14/^23 — V^DetA, A 






-1^12 





—^14 


yUl2 





fJ'23 


— /^24 





-fJ'23 





/^34 



(10) 



y /il4 /i24 — /^34 J 

Since calculating the determinant requires ~ A^^ operations, one finds that re- 
summation of all the single-connected loops in the Loop Series expression for the 
partition function of a planar graphical model can be done efficiently in 0{Nj^) steps. 



3. Tractable Problems Reducible to Single-Connected Partition 

In the case of a general vertex-function graphical model, the BP-gauge transformations, 
described by the set of BP equations ^ , result in exact cancelation in the Loop Series of 
all the subgraphs containing at least one vertex of degree one within the subgraph. Thus, 
for the graph with all vertices of degree three, any vertex contributing a generalized 
loop (subgraph) should be of degree two or three within the subgraph. As shown 
in the previous Section, if one ignores generalized loops with vertices of degree three 
and the original graph is planar, the resulting sub-series (single-connected partition) 
is computationally tractable, i.e. the number of operations required to evaluate the 
single-connected partition is cubic in the system size (not exponential !). 

In this Section we discuss the class of planar models whose Loop Series do not 
contain any generalized loops with vertices of degree three. According to Section [2| 
these models are tractable. 

Indeed, it is known that BP Eqs. ^ have at least one solution for the set of 
messages [r]} on any graph and for any factor functions defined on the vertices of the 
graph. The aforementioned requirement for the generalized loop not to contain any 
vertex of degree three translates into the following set of additional equations 

ia,b)e£ 

W aeQ : ^ fai^a) Y\. (^^P iVabCTab) {c^ab " tauh {r]ab + r]ba))) = 0. (11) 

CTa b 

Considered together, the set of Eqs. 
of T) variables for any values of the factor functions. However, if one allows fiexibility in 
the factor functions, and, in fact, considers Eqs. 
messages {rj} and the factor functions {/}, one arrives at a big set of possible solutions. 

define a big set of models reducible via BP transformations 
to a tractable Loop Series consisting only of single connected loops. 

Moreover, the relations we established may be reversed. One may start from an 
arbitrary Loop Series consisting of only single connected loops, apply an arbitrary 



6pT) is overdefined, i.e. it cannot be solved in terms 



6pT) as a set of conditions on both the 



Therefore, Eqs. (6pT 



§ Except, possibly, the external face. 
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gauge transformation leaving the Loop Series invariant (these transformations are not 
necessarily of BP type), and arrive at a graphical model with some set of factor functions. 
At first sight, the resulting graphical model might not look tractable, but it actually is, 
by construction. 



4. Loop Series as a PfafRan Series 

Let us notice that the general planar problem (e.g. spin glass in a magnetic field) is NP- 
hard [Hj , and it is thus not surprising that full re-summation does not allow expression 
in terms of a single Pfaffian (or a determinant). 

On the other hand, we already found that a part of the Loop Series, specifically 
its single-connected partition, reduces to a computationally tractable Pfaffian. This 
suggests to represent the full Loop Series as a sum over terms, each representing a set 
of triplets (fully colored vertices of degree tree on ^): 

|a|=3 

^ = xi^* n 

where \1/ is either the empty set or any set of even nodes on Q; jia-a = l^a;hcd are the weights 
from Eq. ^ associated with the triplet (a; 6, c, d), such that (a, 6), (a, c), (a, d) G S; and 
zq, is the sum over all generahzed loops (proper Loop Series colorings, i.e. subgraphs) 
of Q such that all nodes of \Ef are fully colored (all edges adjusted to the nodes belong 
to the generalized loop), while any other vertices of Q are not colored or only partially 



colored. Thus, the first term in Eq. (12), where ^ is the empty set, represents the 
single-connected partition, Zg. 



We show here that not only the first term in Eq. (12), associated with \E' = 



but any term z^, in Eq. (12) is computationally tractable, being equal to a Pfaffian of a 
matrix defined on Q^.. 

Indeed, it is straightforward to verify that the generalized loops associated with 
the given set of triplets (fully colored vertices) from the set ^ are in one-to-one 
correspondence with the set of dimer matchings on ^e;*? which is a subgraph of 
with all 3- vertices correspondent to and external edges connected to the vertices, 
completely removed. Notice that some vertices of ^e;* are of degree two. (These are 
vertices neighboring the removed triplets of \E'.) 

An example of a ^e;* construction is given in Figure |4j One associates weights 
to the edges of ^e;* in exactly the same way as for the single-connected partition: the 
weights of all the external edges of 3- vertices of ^e;* are equal to unity, while the internal 
edges are associated with the respective values /ia;6c, defined in Eq. ([3]). 

For any of Qe-,^ one constructs the skew-symmetric A^^ matrix according to the 



Kasteleyn rule for the dimer-matching model described in Section 2.1 As before, the 
dimensionality of the matrix is \Qe;^\ x \Qe;^\ and each element of the matrix is the 
product of the respective dimer weight and orientation sign. Notice that the choice of 
signs for the elements of depends on the set of "excluded" triplets \E', and thus 
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Figure 4. Two generalized loops (shown on the top) of an exemplary Q correspondent 
to the same configuration of triplets G, \G\ = 2, and their respective dimer 
configurations on C/e;* (shown on the bottom). 



is not simply a minor of the original matrix A, the one corresponding to the single- 
connected partition (without exclusion). Thus, 



= Ff(A^ 



Det (Aq, 



(13) 



Eqs. ( T2p3 ) describe the Pfaffian series representation for the Loop Series of the planar 
problem. 



5. Fermion Representation and Models 



Any Pfaffian in Eq. ( 13 ) allows a compact representation in terms of Grassmann variables 



[25] . Indeed, let us associate a Grassmann (anti-commuting or fermionic) variable 6a 
with each vertex of Qe- The Grassmann variables satisfy 

V(a,6)ee?e: eaek + 6^6^ = 0, (14) 

and commute with ordinary c-numbers. One also introduces the Berezin integration 
rules over the Grassmann variables 



de = 0, 



ede = 1. 



(15) 



This translates into the following rule of Gaussian integration over the Grassmann 
variables: 

1 



exp ( -^9'A9] d9 = Pi{A) 



det (A), 



(16) 



where 6 is the vector of the Grassmann variables over the entire graph, 6 = {6i\i G Qa) 
and A is an arbitrary skew-symmetric matrix on the graph. For example, applying this 



formula to the first term of the Pfaffian series ( 12 ) one derives 

exp (-^e'Ae^ de. 



(17) 
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In general, any term in the Pfaffian series of Eq. (12) can be represented as a Gaussian 
Grassmann integrable, however with different Gaussian kernels, not reducible simply to 
minors of A. 

5.1. Graphical Models on Super-Spaces 

In this Subsection we first consider graphical models on spaces generalizing the 2-point 
(binary) set to super-spaces containing commuting and anti-commuting parts. The 
models will be defined on arbitrary (non necessarily planar) graphs. Then, we return 



to the simple example (17) of pure dimer model with the Grassmann (anticommuting) 
variables defined on vertices of Qe, to see that the model can be restated as the vertex- 
function Grassmann model on the original graph Q. 

The general class of vertex-function models can be introduced as follows. For our 
graph, consider a set of spaces {Maa\a G «}, i.e., we associate a space with any edge, 
a, together with a vertex, a, that belongs to the edge. For simplicity we assume the 
spaces to be identical, i.e., Maa — M for all a G a. The basic variables are aaa £ Maa- 
We also introduce the notation (all products below are cartesian) 

= J]M„„, M« = J]M,,, M = l[Maa = l[M, = l[M^- (18) 

a^a aGa aa a a 

ffa&Ma, a^eM^, aeM. (19) 

Note that any Ma is a two-component cartesian product. The vertex-function model is 
determined by a set of vertex functions /a((?a) defined on Ma and a set of integration 
measures dfiai^a) on Mq,. The model partition function is 

f lldfxaiaa)llfaiaa). (20) 

^ a a 

For the particular case when measures have supports restricted to the diagonals 
M = Aq, C Ma = M X M, i.e. supp/Xo, C Aq,, we can consider the basic variables 
that belong to the diagonals. This corresponds to a more conventional formulation of 
the vertex-function models with the variables residing on edges. Note that the models 
introduced allow for loop-tower calculus [2S], formulated in terms of fixing a proper 



gauge. The BP gauge fixing for a general vertex- function model described by Eq. (20) is 
nothing more than choosing basis sets in the vector spaces (maybe infinite-dimensional) 
of functions in Maa- A standard binary model, defined in Eq. ([T|, corresponds to the 
choice M = {0,1} of the basic space to be a 2-point set. Vertex models with g-ary 
alphabet, e.g. discussed in |2S], are described by M = {0, 1, . . . , g — 1}. Continuous 
models are obtained if M is chosen to be a manifold of dimension m. The continuous case 
can be extended to the choice of M to be a supermanifold M of dimension (m_|_, m_) that 
contains m_ Grassmann (anticommuting) coordinates and whose substrate M C M is 
an m+-dimensional manifold. Note that a manifold can be considered as a supermanifold 
with zero odd dimension m_ = 0. In the remainder of this Subsection we will be dealing 
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with an opposite case of the zero even dimension m+ = 0, specifically with the purely 
Grassmann case of the (0, 1) supermanifold. 



Eq. (17) is the partition function of a model stated in terms of Grassmann variables 
defined on the vertices of Qe- The extended graph Qe is constructed from the original 
graph Q so that a vertex of Q extends into a triangle with three vertices of degree 
three (see the left panel of Figure [T]). Therefore, the three Grassmann variables in (17) 



are associated with a vertex of Q. Then, Eq. (17) defined on Q^, allows an obvious 



reformulation in the vertex- function form (20) on Q, where (?„ represents the three 
Grassmann variables that reside on the vertices of Qe, obtained by expanding the vertex 
a of the original graph. The dimer weights for the three edges of Qe associated with the 
extended vertex of Q are encoded in the Gaussian function fa{^a)- The dimer weight 
associated with an edge of Qe that represents and edge a of the original graph Q is 
encoded in the integration measure dfiai^a)- 

Also notice that the vertex-function Grassmann model on a planar graph Q can 
be restated as a model on the triangulated graph, dual to Q, with complex fermion 
(Grassmann) variables associated with the edges of the dual graph and functions 



associated with a face (elementary triangle) of the dual graph (Figure A3 illustrates 
the duality transformation). One interesting conclusion here is that the sequence of 
transformations discussed above leads us from a special binary model on a planar graph 
^ to a Gaussian fermion (Grassmann) model on the dual graph, thus representing an 
instance of the disorder operator approach of Kadanoff-Ceva [27] developed originally 
for the Ising model on a square lattice. 

5.2. Comments on Relation to Quantum Algorithms and Integrable Hierarchies 

A mapping of a classical inference problem onto finding an expectation value in a 
corresponding quantum model takes on a natural interpretation as a quantum algorithm. 
This can be tried by using the theory of the infinite Kadomtsev-Petviashvilii (KP) 
hierarchy, specifically its fermionic formulation |28]. Consider ID lattice fermions 
ipkyi'k with k & Z and introduce the population = il'l'ipk and shift operators 
Hk = J2jez'^k+j'^j- Let |0) denote the standard many-particle vacuum state where 
all single-fermion orbitals with A; < are occupied, and \W) is some uncorrelated (i.e. 
represented by a single Slater determinant) many-particle state, which is sufficiently 
close to |0). Introducing t = ti, ^2, • • •, i = tQ,ii,i2, . . and ^ = . . . , ^o, • • • we 
consider an expectation value 

The approach is based on mapping the partition function of a classical inference problem 



on a graph onto a calculation of an expectation value represented by Eq. (21 ). We have 
established such a mapping for some simple Grassmannian models on planar graphs 
[29] . where all the details on the suggested approach will be presented. Note that in 
the case ^ = and t = the expectation value Z]y(t, 0,0) = T]y(t) is related to the 
r-function of the KP integrable hierarchy. 
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6. Future Challenges 

We conclude with a brief and incomplete discussion of future challenges and 
opportunities raised by this study. 

• We plan to extend the study looking at new approximate schemes for intractable 
planar problems. One new direction, suggested in Section |3| consists of exploring 
the vicinity of the computationally tractable models reducible via the BP-gauge 
transformation to the series of single-connected loops. It is also of great interest to 
explore the vicinity of integrable tractable models mentioned in |5.2[ 

• Perturbative exploration of a larger set of intractable non-planar problems which are 
close, in some sense, to planar problems, constitutes another interesting extension 
of the research. Here, one would aim to blend the aforementioned planar techniques 
with planar (or similar) decomposition techniques, e.g. these of the type discussed 
in [H]. 

• One important component of our analysis consisted in the Pfaffian re-summation 
of the single-connected loop (dimer) contributions, which is a special feature of the 
graph planarity. On the other hand, it is known that the planarity is equivalent to 
the graph being minor-excluded with respect to and K^^s subgraphs. Therefore, 
one wonders if there exists a generalization of the Pfaffian reduction to partition 
functions of models from other and/or broader graph-minor classes defined within 
the graph-minor theory [30]?Likewise, comparing with previous studies of the non- 
planar /non-spherical cases, based on the dimer approach [HI ] IS ^ [33]. 

• Extending the Loop Series analysis of the binary planar problem to the q-ary case 
seems feasible via the Loop Tower construction of [26j. This research should be of a 
special interest in the context of recently proposed polynomial quantum algorithm 
for calculating partition function of the Potts model [M]. Besides, recent progress 
[35| 136] shows that a Kasteleyn-type approach is extendable to a g-ary case, leading 
to the concept of "heaps of dimers", and (in the continuum limit) to fascinating 
connections with special, highly symmetric complex surfaces, known as Harnack 
curves. 

• One would also be interested to study how (and if) phase transitions in the disorder- 
averaged planar ensembles, e.g. analyzed in j57l[5gl[5giggil?nii21li51IMH5]. 
are related to distribution of parameters characterizing computational tractability 
(complexity) of the models. 

• In [3S], the problem of finding all pseudo-codewords in a finite cycle code 
(corresponding to the type of graphical model discussed in this paper), was 
addressed by constructing a generating function known as graph zeta function |17] . 
The interesting fact discovered in |16] is that this generating function of pseudo- 
codewords has a determinant formulation, based on a discrete graph operator. 
Hence, one may anticipate an existence of yet uncovered relation between the graph 
zeta function and a Pfaffian-Loop resummation of related graphical models. 
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Appendix A. Graphical Transformations 

In this Appendix we discuss graphical transformations reducing any binary problem to 
the vertex-function model described by Eq. Q, where all vertices are of degree three. 
Our main focus here is on the planar graphs, and on the graphical transformations 
preserving planarity. However some of the transformations and considerations discussed 
below apply to an arbitrary graph. 

Often the original binary model is not represented in the vertex-function form. 
Some or all binary variables describing a problem may actually be assigned to vertices 
of a graph, then respective functions are associated with edges and not vertices. 
Obviously, one can also reformulate the model reducing it to the vertex (canonical 



for our purposes) form. The transformation is illustrated in Figure Al Algebraic form 
of the transformation shown in the Figure reads, J2ai /i2(t'"i7 c"2)/i3(o"i7 c"3)/i4(o"i) cr4) = 
^^i2,<Ti3,ai4 x(o-i2, 0-13, o-i4)/i2(o-i2, (^2) fisi^is, a3)fuiau, (T4), whcre xi(^i2, 0-13, CTu) is the 
characteristic function equal to unity if all variables 0-12, 0-13, 0-14 are equal each other 
and equal to zero otherwise. 

Next, let us notice that, given a vertex-function model ([T]) with the degree of 
connectivity higher than three, one can always perform a sequence of transformations 
reducing the degree of connectivity of all the nodes in the resulting graphical model to 



/i2(cti, 0-2) 
|2 



/l2(o'12-CT2) 



3 ✓ N 4 
✓ S 

/l3('71,CT3) /l4(ffl."4) fi^f^,CJs) /l4(CT14^<r4) 



I ^ \(f^l2,f^l3-'^14) 



Figure Al. Transformation from binary variable on a vertex, cti, to set of variables, 
0-12, fi3, (714 on respective edges. 
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Figure A2. Transformation which allows reduction of an TV-vertex to two {N — 1)- 
vertices. It is assumed that (1) number of nodes in the gray area is not large, i.e. 
0{N), (2) the new graph (on the right) is planar, (3) ordering (say clockwise) of the 
external nodes is preserved. The number of parameters characterizing the A^-vertex is 
2^ or smaller, thus the number of parameters characterizing the two {N — 1) vertices 
and vertices from the gray area is sufficient, i.e. > 2-2^~^, to parameterize the original 
vertex. 



Figure A3. Planar triangulated graph (black) and its dual (red). 



three. An elementary graphical transformation of the kind is illustrated in Figure A2 



It is assumed that the transformation is apphed sequentially to vertices of degree larger 
than three till none of these are left. The end result is that: (a) there are no vertices 
of degree larger than three left within the graph; (b) the increase in the total number 
of vertices is polynomial; (c) if the original graph is planar the resulting graph is also 
planar. 

The set of transformations just described is general, and thus often inefficient, in 
the sense that knowing specific form of the factor functions one can practically always 
do a more efficient, customized and simpler reduction. Below we will illustrate this point 
on examples. 
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Appendix A.l. Ising Model 

The spin glass Ising model is usually defined in terms of cXj = ±1 variables associated 
with vertices of the graph 

p{(t) = exp 1 ^ Jijaiaj , (A.l) 

where summation under the exponential on the r.h.s. goes over all edges of the graph, 
and Jij associated with an edge can be positive or negative. Obviously one can apply 



the vertex-to-edges transformation, explained in Figure Al , to restate the spin glass 
Ising model as a vertex-function model. However, in this case one can also do a simpler 
transformation to the dual graph. Let us consider a planar triangulated graph F shown 



in black in Figure A3 All vertices of the respective dual graph, F^, shown in red in 
Figure A3, have degree of connectivity three. We assume that the spin glass Ising model 
is defined on the planar triangulated graph F. Defining a new variable aab on an edge 
of Td as the product of two variables of the original graph (Tab = o'lCrj connected by an 
edge {i,j) of F crossing the edge {a,b of F^, one finds that the sum on the r.h.s. of 
Eq. (A.l), rewritten in terms of the new variables, becomes, ^(^ab)&ra •JabO'ab- However, 



the new variables, aab are not independent, but rather related to each other via a set of 



local constraints, Va G F^: Yl^^'''^'^^'^ (Jab = 1- Then, Eq. (A.l) restated in terms of the 



new variables on the dual graph gets the following compact vertex-style form 

/ \ /(a,fe)erd \ 

pM = exp Yl '^-''(rab n ^ n 1 • (^-2) 
\(a,b)erd J aer \ b J 

One interesting observation is that the allowed configurations of cr^ = (aab\{a, h) G F^) on 
the dual graph correspond exactly to the single-connected loops on F^, where the loops 
are built from the excited, aab = —1, edges. Therefore, and in accordance with discussion 
of Section [2} calculation of the partition function for the spin glass Ising is reduced to 
evaluation of the respective Pfaffian, which is the task of a polynomial complexity. 
Notice also that adding a magnetic field (linear in a) term in the expression under the 



exponent on the r.h.s. of Eq. (A.2) will raise the complexity level to exponential. 



Appendix A.2. Parity-Check Based Error- Correction 

Consider a linear code with the code-book defined in terms of the bi-partite Tanner 
graph, G = {Vb,Vc,S) consisting of = \Vb\ bits and M = \Vc\ parity checks, 
and the set of edges S relating bits to checks and checks to bits. Then a message 
a = (cTj = 0, l|i = 1,---A^) is a codeword of the code if it satisfies all the parity 
checks, i.e. Va = 1,---M : Hi*''^''^^^* — +1- Assuming that all the codewords are 
equally probable originally, and that the white channel transform a bit a of the original 
codeword into the signal x with the probability p{x\a), one finds that the probability 
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Figure A4. An illustrative example of a Tanner graph (left) , as well as check- vertex 
(A) and bit-vertex transformations. 



for (T to be a codeword resulted in the measurement x is 



p{(t\x) 



1 



a£Vc 



(A.3) 

2 p{xi\ - 1) 



where, as usual, the partition function Z is fixed by the normalization condition, 
^.p(<j|f) = 1. 



Eq. (A.3) represents an example of a mixed graphical model, with variables Uj 



defined on bit-vertices, the parity-check functions defined on check-vertices and the 
channel functions (carrying the dependencies on the log-likelihoods hi) also associated 
with the bit-vertices. In this case transformation to the vertex-style model is done by 



direct application of the vertex-to-edges procedure of Figure XT to all the bit-vertices 
of G. Then, the vertex-style version of Eq. ( |A.3[ ) becomes 

p{a\x) = II Ua) l[ fv 



Mi : 
Va : 



aeVc ieVt 
Oi = {(Jia = ±l\{i,a) e £), 

exp{hiaia), Va,/5s.t. 
0, 



{i,a), {i,(3) e S 
otherwise 



n 



(A.4) 
(A.5) 
(A.6) 

(A.7) 



In general, degree of connectivity of bit- vertices and check- vertices may be arbitrary. 



Direct application of the general procedure explained above (see Figure Al and 
discussion therein) allows to reduce all the higher-degree nodes to a larger set of nodes 
of degree three. However, a simpler dendro-reduction is possible both for the bit-vertices 
and check-vertices. The dendro trick (e.g. discussed in ^48j for complexity reduction of 
a Linear Programming decoding of LDPC codes) is schematically illustrated in the two 
right panels of Figure |A4[ where respective algebraic relations are 

(A): s(j[ai,+l]= (A.8) 
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S{(Tia2Cri2, +1)5((73(74(734, +l)5((J5(76(756, +l)S{ai2(TuCr56, +1), 

(B): 5(ai,---,a6)= (A.9) 

(5(cri, (T2, Cri2)5((T3, (74, (T34)(^(c'-5, (Te, (756)(5((7i2, (734, (Tse), 

0"12,0"34,0"56=±1 

and 5((Ji, • • • , (Je) is equal to unity if all arguments are the same, and it is zero otherwise. 
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